Item tracking using a dynamic region of interest

ABSTRACT

Systems, devices, and methods for monitoring items in a defined physical area can include a primary camera configured to detect a region of interest within a defined physical area and the coordinates of the region of interest in the defined physical area. A plurality of secondary cameras can positioned throughout a defined physical area. One of the secondary cameras can be selected to capture an image of a region of interest based on the coordinates of the region of interest.

INCORPORATION BY REFERENCE TO ANY PRIORITY APPLICATIONS

Any and all applications for which a foreign or domestic priority claimis identified in the Application Data Sheet as filed with the presentapplication are hereby incorporated by reference under 37 CFR 1.57. Thisapplication claims the benefit of priority to U.S. ProvisionalApplication No. 62/353,431, filed Jun. 22, 2016, the entire contents ofwhich are hereby incorporated by reference.

FIELD

This invention relates to tracking items in an area such as a processingfacility.

DESCRIPTION OF THE RELATED TECHNOLOGY

In item tracking systems, items can be labeled with a computer readablecode, such as a barcode, that can be used to identify the itemthroughout various stages of delivery. These computer readable codes canstore information regarding the intended destination of an item.

SUMMARY

Aspects of the present invention include systems, devices, and methodsfor monitoring items in a defined physical area using a plurality ofcameras.

One aspect is a system for capturing images in a defined physical area.The system includes a primary camera having a field of view comprising aportion of the defined physical area comprising one or more imagesensors, wherein the primary camera is configured to receive image datafrom the one or more image sensors, a plurality of secondary cameras,each secondary camera having a field of view comprising a section of thedefined physical area, each secondary camera comprising one or moreimage sensors configured to capture an image, and one or more processorsconfigured to determine a set of spatial coordinates of a potentialregion of interest within a defined physical area based on image datareceived by the image sensors of the primary camera, determine one ofthe plurality of secondary cameras to capture an image of the potentialregion of interest based on the determined set of spatial coordinates,and instruct the one of the plurality of secondary cameras to capture animage of the potential region of interest.

Another aspect is a method for capturing images in a defined physicalarea. The method includes detecting, via a primary camera, a potentialregion of interest, determining spatial coordinates of the potentialregion of interest, determining a secondary camera of a plurality ofsecondary cameras to capture an image of the potential region ofinterest based at least in part on the determined spatial coordinates,and capturing an image of the potential region of interest by thedetermined secondary camera.

Another aspect is a system for capturing images in a defined physicalarea. The system includes primary means for receiving image data havinga field of view comprising a portion of the defined physical area, aplurality of secondary means for receiving image data, each secondarymeans for receiving image data having a field of view comprising asection of the defined physical area, means for processing image datareceived by the primary means for receiving image data to determine aset of spatial coordinates of a potential region of interest within adefined physical, and determine one of the plurality of secondary meansfor capturing image data to capture an image of the potential region ofinterest based on the determined set of spatial coordinates, and meansfor instructing the one of plurality of secondary means for capturingimage data to capture an image of the potential region of interest.

In another aspect described herein, system for sorting an item comprisesa primary camera having a field of view comprising a portion of adefined physical area, the primary camera in communication with acentral unit, and where the primary camera is configured to identify anitem within the defined physical area; a plurality of secondary camerasin communication with the central unit, each of the plurality ofsecondary cameras having a field of view comprising a section of thedefined physical area; and wherein the central unit comprises one ormore processors configured to: determine spatial coordinates of a regionof interest located on the item within a defined physical area, based onimage data received by the primary camera; identify one or more of theplurality of secondary cameras having a field of view including thedetermined spatial coordinates; and cause the identified one or more ofthe plurality of secondary cameras to capture an image of the region ofinterest.

In some embodiments, the one or more processors are further configuredto process an image of the region of interest to extract machinereadable information located within the region of interest.

In some embodiments, the information comprises an intended deliverydestination for the item.

In some embodiments, the one or more processors are further configuredto identify a location within the defined physical area for placement ofthe item based on the intended delivery destination for the item.

In some embodiments, the region of interest comprises a segment of anitem, wherein the machine-readable information comprises one or more ofinformation associated with identifying the item, tracking the item, adestination of the item, a source or sender of the item, sorting data,and routing information regarding the item.

In some embodiments, the potential region of interest comprises asegment of an item, wherein the one or more processors are configured toprovide instructions to one or more of the primary camera and theplurality of secondary cameras to capture image data related to themovement of the item having the potential region of interest; anddetermine if the item having the potential region of interest isdeposited in a container.

In some embodiments, the processor is further configured to store dataassociating an item with a container in which the item is deposited.

In some embodiments, the system further comprises one or more indicatorsconfigured to provide an indication of the determined location withinthe defined physical area for placement of the item.

In another aspect, a method for tracking items comprises detecting, viaa primary camera, a potential region of interest located on an itemwithin a defined physical area; determining spatial coordinates withinthe defined physical area of the potential region of interest;determining a secondary camera of a plurality of secondary cameras tocapture an image of the potential region of interest based at least inpart on the determined spatial coordinates; and capturing an image ofthe potential region of interest by the determined secondary camera.

In some embodiments, the method further comprises extractingmachine-readable information from in the region of interest.

In some embodiments, the method further comprises determining a locationwithin the defined physical area for placement of the item based on theinformation extracted from the region of interest; and indicating thedetermined location within the defined physical area for placement ofthe item.

In some embodiments, the method further comprises capturing image datarelated to the movement of the potential region of interest; andprocessing the captured image data related to the movement of thepotential region of interest to determine information regarding thelocation of the potential region of interest.

In some embodiments processing the captured image data related to themovement of potential region of interest comprises determining that theitem was deposited in a container located within the defined physicalarea.

In another aspect, a system for capturing images in a defined physicalarea, the system comprises means for detecting a potential region ofinterest located on an item within a defined physical area; means fordetermining spatial coordinates within the defined physical area of thepotential region of interest; means for determining a secondary cameraof a plurality of secondary cameras to capture an image of the potentialregion of interest based at least in part on the determined spatialcoordinates; and means for capturing an image of the potential region ofinterest by the determined secondary camera.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an embodiment of a camera system for monitoring items ina defined physical area.

FIG. 2 depicts a block diagram of an embodiment of a camera system.

FIG. 3A depicts an example of camera system 100 in a first stage ofmonitoring an item 120 in a defined physical area.

FIG. 3B depicts an example of camera system in a second stage ofmonitoring an item in a defined physical area.

FIG. 3C depicts an example of camera system in a third stage ofmonitoring an item in a defined physical area.

FIG. 4 depicts a flowchart of an exemplary process for determining itemdata.

FIG. 5 depicts a flowchart of an exemplary process for associating anitem with a container.

DETAILED DESCRIPTION

As will be appreciated by one skilled in the art, there are numerousways of carrying out the examples, improvements, and arrangements of anitem tracking system in accordance with embodiments of the inventiondisclosed herein. Although reference will be made to the illustrativeembodiments depicted in the drawings and the following description,these embodiments are not meant to be exhaustive of the variousalternative designs and embodiments that are encompassed by thedisclosed invention. Those skilled in the art will readily appreciatethat various modifications may be made, and various combinations can bemade, without departing from the invention.

In the following detailed description, reference is made to theaccompanying drawings, which form a part hereof. In the drawings,similar symbols typically identify similar components, unless contextdictates otherwise. The illustrative embodiments described in thedetailed description, drawings, and claims are not meant to be limiting.Other embodiments may be utilized, and other changes may be made,without departing from the spirit or scope of the subject matterpresented here. It will be readily understood that the aspects of thepresent disclosure, as generally described herein, and illustrated inthe Figures, may be arranged, substituted, combined, and designed in awide variety of different configurations, all of which are explicitlycontemplated and make part of this disclosure.

Reference in the specification to “one embodiment,” “an embodiment”, or“in some embodiments” means that a particular feature, structure, orcharacteristic described in connection with the embodiment is includedin at least one embodiment of the invention. Moreover, the appearance ofthese or similar phrases throughout the specification does notnecessarily mean that these phrases all refer to the same embodiment,nor are separate or alternative embodiments necessarily mutuallyexclusive. Various features are described herein which may be exhibitedby some embodiments and not by others. Similarly, various requirementsare described which may be requirements for some embodiments but may notbe requirements for other embodiments.

As used herein, an item, or a distribution item, can be a parcel, apackage, an envelope, a flat, a mailpiece, a box, a suitcase, or anyother item that can be transported from one location to another by adistribution entity. A distribution entity may be an entity engaged inreceiving, sorting, and/or transporting items from one location toanother, such as the United States Postal Service (USPS), anothercommercial carrier, a storage facility, a fulfillment warehouse, aluggage sorting facility, or any other similar facility, company, orentity.

Using the USPS as an example, an item, such as a parcel, mailpiece, orthe like has a label thereon, or information printed directly on theitem (also referred to as a label herein), which indicates, among otherthings, a sender, a delivery point (destination), a class of service,postage, and a tracking code. The labels include computer readable codeswhich can encode the above items of information. The labels can directlyencode the above and other information, or can encode a code that isassociated with the above and other information.

As used therein, the term “camera” can refer to any type of imagecapture device capable of capturing an image, for example, a digitalcamera, an optical scanner, a barcode reader, and the like.

As used herein, the term “region of interest” can refer to a portion ofan item within a defined physical area that contains a machine-readablecode, label, image, and the like. For example, a region of interest maybe a section or portion of an item that includes written, printed, orencoded information such as a barcode, a QR code, a destination address,a return address, payment information such as postage, item informationsuch as weight, dimensions, contents, the item sender, originator, andthe like.

A distribution item in a distribution system can include a computerreadable label thereon. The label may be scanned, for example, duringsorting, prior to depositing in a storage container, prior to depositingin a vehicle for transport, when unloading from a vehicle, and whendelivered to a final destination. Throughout the delivery process, anitem may be transported to and handled at multiple item deliveryfacilities. The item may also be moved between multiple storagecontainers and transportation vehicles. Employees in a delivery facilitymay handle and load items into a desired storage container or vehicle,and scan the label on the item at each stage in order to provide acomplete and accurate history of the item's location. In some instances,items are moved throughout a facility using conveyor belts and otherequipment to sort items for delivery according to destination. Labelscanners may be positioned to read labels on the items as they are beingsorted by the sorting equipment. Information from the labels can beutilized for tracking and routing of items.

Some aspects of the present disclosure describe a system for identifyingand processing items using a series of cameras within an area, such asan area of the processing facility. For example, a processing facilitycan include an item sorting area. The area is monitored by one or morecameras capable of imaging labels on items and interpreting the computerreadable codes thereon. When an item having a label thereon is movedinto the monitored area, such as for sorting, one or more of the camerasidentifies the item, focuses on the label, identifies a region of thelabel having the computer readable code, and reads the code. The camera,or a processor, interprets the image and the computer readable code toidentify the intended destination of an item. The system then displays asorting location for the item, such as bin, hamper, pallet, and thelike, where the item should be placed. As the item is placed in thesorting location, the processor updates an item tracking database,storing the location of the item in the database.

In one embodiment, a camera system is provided that is configured tomonitor a defined area to identify potential regions of interest forfurther image processing. The camera system can include a plurality ofcameras viewing a defined physical area including a primary camera andseveral secondary cameras. The primary camera can be positioned to viewthe entirety of the defined physical area. The defined physical area canbe a sorting room, a staging area, a loading dock, or other facility orportion of a facility where items are sorted and/or staged for furtherprocessing and delivery. The secondary cameras can be positioned atseveral locations within the defined physical area, each secondarycamera being positioned to view a section of the defined physical areaand configured to capture images within the section of the definedphysical area.

The primary camera may further include a processor configured todetermine a potential region of interest, such as the location of acomputer readable code on an item, and the spatial coordinates thereofwithin the defined physical area. The primary camera can also include acommunication module configured to transmit data to an external device,such as for example, spatial coordinate data for a region of interest.

The camera system may further include a central unit having acommunication module, a processor, and a memory. In some embodiments,the primary camera is in communication with a central unit, which isconfigured to process and interpret the images, and which can be incommunication with one or more other processors and one or morememories, such as, for example, an item database.

The central unit can be configured to receive data from the primarycamera via the communication module and process the data to determinewhich of the secondary cameras is suitable for capturing an image of thepotential region of interest. The central unit can transmit data to thedetermined secondary camera(s) including the spatial coordinates of thepotential region of interest and/or instructions for adjustment ofcamera position and/or focus in order to capture or maintain an image ofthe potential region of interest within the camera's field of view. Eachsecondary camera can include a communication module configured toreceive data from the central unit. Each secondary camera may alsoinclude a processor configured to process spatial coordinate data inorder to determine adjustments in camera positioning and focus in orderto capture an image of the potential region of interest. Each of thesecondary cameras can include one or more actuators or motors configuredto perform pan, tilt, and/or zoom functions in order to capture an imageof the potential region of interest, or to follow the region of interestthrough the defined physical area. Following adjustment of a secondarycamera to the potential region of interest, the secondary camera cancapture an image of the potential region of interest, or move tomaintain a field of view which includes the region of interest, whichcan be transmitted to the central unit for processing. The central unitmay parse the captured image or a video feed of the potential region ofinterest for data, such as for example, a label, which may be utilizedto track an item upon which the region of interest is positioned.Examples of items that may include a region of interest include deliveryitems, containers, and transport vehicles.

Using the described system, an item having a region of interest thereoncan be tracked within the defined physical area and a position of theitem within the defined physical area can be tracked, determined, andrecorded. For example, the described system can determine and record theposition or placement of an item within a container, a defined stagingarea, portion of a loading dock, or transport vehicle. The system canthen associate the item with the corresponding container or transportvehicle.

In some embodiments, a storage unit, a container, or a transportationvehicle may be within the defined area. These may also include one ormore regions of interest having information that can be extracted by thecamera system. The storage unit, staging area, loading dock, container,or transport vehicle may include encoded information in the region ofinterest identifying the storage unit, staging area, loading dock,container, or transport vehicle. An item may have encoded information inits region of interest identifying the item as a specific item, such asa parcel, package, letter, flat, and the like. In some embodiments, thecamera system can determine that an item has been deposited within acontainer, a staging area, a portion of a loading dock, or a transportvehicle by determining that the item is positioned at a set of spatialcoordinates within a set of spatial coordinates occupied by the storageunit, container, staging area, portion of a loading dock, or transportvehicle. In some embodiments, the camera system can determine the itemhas been placed in a container, storage unit, or vehicle by analyzing animage of the item in proximity to the region of interest on thecontainer, storage unit, or vehicle. If the item is within a predefinedarea on the image, such as within a predefined number of pixels, thesystem can determine the item is within the container, storage unit, orvehicle, and the system can update the item location in the itemdatabase. In some embodiments, the image is analyzed to determine anactual distance the item is from the container, storage unit, orvehicle. If the determined actual distance is within a predeterminedthreshold from the container, storage unit, or vehicle, then the itemcan be determined to be in the container, storage unit, or vehicle, andthe item location can be updated in the item database.

In some embodiments, a processor may perform logical operations todifferentiate between an item and a container or transport vehicle basedon size, shape, or any other detectable characteristic. The processormay determine that an item is deposited within a container or transportvehicle based on receipt of image data through one or more of theprimary camera and the secondary cameras showing the item within orpartially within the container or transport vehicle. When an item isdetermined to be within an container, storage unit, or transportvehicle, the processor can update the item's position in the database,such as associating the container, storage unit, or vehicle with atleast a portion of the computer readable code, or with a unique itemidentifier.

FIG. 1 depicts a camera system 100 for monitoring items within a definedphysical area positioned within a room 101. The room 101 can be aportion of a distribution facility, such as a loading dock, a sortingstation, a warehouse, or any other facility or area. The camera systemincludes a primary camera 105 and a plurality of secondary cameras110A-J. The camera system 100 is configured to monitor a definedphysical area 115 for items having potential regions of interest. Thedefined physical area is the portion of the room 101 which is within thefield of view of the primary camera 105, or which is within a potentialfield of view of the primary camera 105, as the primary camera 105 movesor pans about the room. At least portions of the defined physical area115 are also within the field of view of one or more of the secondarycameras 110A-J.

The primary camera 105 is configured to monitor the entirety of thedefined physical area 115 for potential regions of interest and todetermine the spatial coordinates thereof. The primary camera 105 can bepositioned so that the entirety of the defined physical area 115 iswithin its field of view. The field of view of the primary camera 105corresponds to the visible area captured by image sensors (not shown) ofthe primary camera 105, and may be constrained by a size of atwo-dimensional camera sensor array (e.g., number of row and columnpixels on an image sensing chip) and the desired resolution of an image.The resolution may be measured in dots per inch (DPI). For example, whenusing an overhead primary camera 105, the desired resolution may beaffected by the size of the camera sensor array and the height of thecamera over an object being scanned. A primary camera 105 positionedfurther away from a particular area may have a larger field of view thana primary camera 105 positioned closer to the area, but may have a lowerresolution. The primary camera 105 can have a sufficiently high DPI todetect potential regions of interest within the entirety of the definedphysical area 115. The primary camera 105 may further be configured todetermine the spatial coordinates of a potential region of interestwithin the defined physical area 115. Spatial coordinates can includecoordinates in two or three dimensions. For example, the primary camera105 can be configured to determine x, y, and z coordinates of apotential region of interest within the defined physical area 115. Insome embodiments, the primary camera 105, itself or by a processor incommunication with the primary camera 105 can receive an image of atleast a portion of the defined physical area 115. A processor analyzesthe image to identify a portion of the image having a computer readablecode thereon. The image includes metadata or other data associated withthe image, such as the position, angle, depth of field, etc., of theprimary camera 105 when the image was taken. The processor takes theimage and related data, and the determination of the region of interest,and converts the image data into spatial coordinates corresponding to athree-dimensional location within the defined physical area 115. Theconversion of image data can be done according to algorithms includingthe camera position, structural features in the image, which may beidentified in the defined physical area 115 using high contrastmarkings, and the like, or which can correspond to the floor, a wall,etc. The converted image data is provided to a processor, or can be usedwithin the processor that analyzed the image. This data is convertedinto instructions to the secondary cameras 110A-J on how to move, pan,zoom, and/or focus in order to capture the region of interest on theitems.

In some embodiments, the central unit 140 can receive an image of thepotential region of interest, and can convert the image from a colorimage to a grayscale image for further processing, or to improve speedof subsequent processing. The central unit 140 can convert an image fromone file format to another as desired or required for decoding theinformation in the image. In some embodiments, the central unit 140receives the image of the potential region of interest, identifies theportion of the image having the potential region of interest therein,and crops or trims the image to only process the portion of the imagehaving the potential region of interest therein.

Each of the secondary cameras 110A-J are positioned to monitor a sectionof the defined physical area 115 and to capture images within thatsection of the defined physical area 115. Each of secondary cameras110A-J can be selectively adjustable to different orientations in orderto facilitate the capture of images within the section monitored by thatparticular secondary camera. For example, the secondary cameras 110A-Jcan include pan, tilt, and zoom functionality in order to capture imagesof potential regions of interest, where panning generally refers torotation in a horizontal plane and tilting generally refers to rotationin a vertical plane, and zooming refers to changing the focal point of alens system. The secondary cameras 110A-J may be pan-tilt-zoom cameras,in which the direction of the camera can be adjusted through physicalcamera movement, or virtual pan-tilt-zoom cameras, in which a cameradigitally pans, tilts, and zooms into portions of an image.

In some embodiments, one or more of the secondary cameras 110A-J areconfigured to capture an image of a potential region of interest at aset of spatial coordinates detected by the primary camera 105 or tofollow the region of interest through the defined physical area 115.Each of the secondary cameras may be configured to capture an image witha resolution sufficient for the reading and processing of data withinthe potential region of interest. For example, each of the secondarycameras 110A-J may have a sufficiently high DPI to support opticalcharacter reading (e.g., 200 DPI or greater) as well as barcodedecoding. In some embodiments, the secondary cameras 110A-J arepositioned and configured such that at least one of the secondarycameras 110A-J is capable of capturing a machine-readable image of aregion of interest at each set of spatial coordinates within the definedphysical area 115 or to follow the region of interest through each setof spatial coordinates within the defined physical area 115. By usingone or more secondary cameras 110A-J, the possibility that the region ofinterest is within the field of view of at least one of the secondarycameras 110A-J.

When the primary camera 105 and/or an associated processor identifiesthe spatial coordinates of the potential region of interest, the primarycamera 105 and/or the associated processor determines which of thesecondary cameras 110A-J is likely to have the closest, clearest, orbest image of the potential region of interest, and instructs thatsecondary camera to take an image, to pan, tilt, or zoom to capture animage of the potential region of interest.

The defined physical area 115 for monitoring by a camera system 100 isnot limited to the particular shape or size of defined physical area115, but can include an area of any shape or size. The camera system 100is not limited to the configuration shown in FIG. 1. The primary camera105 may be positioned in any position capable of receiving image datafor an entirety of the defined physical area 115, for a substantialportion of the defined physical area 115, or for any desired portion ofthe defined physical area 115. Any number of secondary cameras 110A-Jmay be used in any configuration so that at least one secondary camera110 is capable of capturing an image of a region of interest at eachspatial coordinate within the defined physical area 115. In someembodiments, the secondary cameras 110A-J can be disposed radially orcircumferentially around the defined physical area 115. In someembodiments, the secondary cameras 110A-J can be disposed such that somesecondary cameras 110A-J are mounted higher on a wall and some aremounted lower on a wall. In some embodiments, the primary camera 105and/or one or more secondary cameras 110A-J can be mounted over head ofthe defined physical area 115.

FIG. 2 depicts a block diagram of the camera system 100. The camerasystem 100 includes the primary camera 105, the secondary camera 110A, acentral unit 140, a computer system 150, and one or more indicators 160.Although FIG. 2 depicts only secondary camera 110A, it should berecognized that the features and functionality described with respect tosecondary camera 110A can be present in each of the secondary cameras110A-J.

The primary camera 105 includes one or more image sensors 106, aprocessor 107, a communication module 108, and a memory 109. The imagesensors 106 may be charge-coupled device (CCD) pixel sensors,complementary metal-oxide-semiconductor (CMOS) pixel sensors, hybridCCD/CMOS image sensors or N-type metal-oxide-semiconductor (NMOS) imagesensors. The processor 107 can control operations of the primary camera105. The processor 107 may perform logical and arithmetic operationsbased on program instructions stored within the memory 109. The memory109, which may include both read-only memory (ROM and random-accessmemory (RAM), provides instructions and data to the processor 107. Aportion of the memory 109 may also include non-volatile random-accessmemory (NVRAM). The instructions in the memory 109 may be executable toimplement the methods described herein.

The processor 107 is configured to receive and process data from theimage sensors 106 to determine the presence of an item within thedefined physical area, and to identify one or more potential regions ofinterest on the item. The processor 107 is further configured to processdata from the image sensors 106 to determine spatial coordinates of theone or more potential regions of interest. The memory 109 can be used tostore instructions for processing image sensor data using the processor107. In some embodiments, spatial coordinates are determined based ondistances from the primary camera 105. In other embodiments, spatialcoordinates may be determined based on a programmed reference map havingcoordinate data for the primary camera 105 and secondary cameras 110A-J.Information determined by the processor 107, such as the spatialcoordinates of a potential region of interest, can be stored in thememory 109 and/or transmitted to the central unit 140 using thecommunication module 108.

The communication module 108 may include communication circuitry toallow for the transmission and/or reception of data between the primarycamera 105 and one or more external devices, including the central unit140. For example, data related to the spatial coordinates of a potentialregion of interest may be transmitted from the primary camera 105 to thecentral unit 140 via the communication module 108. The communicationmodule 108 may be configured to communicate via any wired or wirelesscommunication technologies, such as, for example, Bluetooth, WIFI, orother means. In some embodiments, the central unit 140 may be used tocontrol the operation of the primary camera 105 by transmitting data tothe communication module 108.

The central unit 140 includes a processor 141, a memory 142, and acommunication module 143. The processor 141 can control operations ofthe central unit 140. The processor 141 may perform logical andarithmetic operations based on program instructions stored within thememory 142. The memory 142, which may include both read-only memory (ROMand random-access memory (RAM), provides instructions and data to theprocessor 141. A portion of the memory 142 may also include non-volatilerandom-access memory (NVRAM). The instructions in the memory 142 may beexecutable to implement the methods described herein. The memory 142 canalso be used to store instructions for processing data received from theprimary camera 105 and the one or more secondary cameras 110A-J.Information determined by the processor 141 can be stored in the memory142 and/or transmitted to the primary camera 105, the secondary cameras110A, the computer system or database 150, the indicators 160, and/orthe central unit 140 using the communication module 143. The database150 can be located with the central unit 140, or can be remote from thecentral unit 140, and can comprise one or more servers, processors,memories, and the like.

The communication module 143 may include communication circuitry toallow for the transmission and/or reception of data between the centralunit 140 and one or more external devices, including the primary camera105, and the secondary camera 110A. The communication module can alsotransmit data to and/or receive data from database 150. Thecommunication module can also transmit data to and/or receive data fromthe indicators 160. For example, data related to the spatial coordinatesof a potential region of interest may be transmitted from the primarycamera 105 to the communication module 143 of central unit 140. Thecommunication module 143 may be configured to communicate via any wiredor wireless communication technologies, such as, for example, Bluetooth,WIFI, or other means. The database 150 also can store information aboutthe sort plan, the intended delivery destination of items, containers,and transport vehicles, the layout of the staging areas and loadingdocks, and other information about the room 101. For example, thedatabase

The processor 141 is configured to receive and process data, such asimages or live video, from the primary camera 105 in order to determinethe spatial coordinates of one or more potential regions of interest.The processor 141 can also determine which direction the potentialregion of interest is facing, for example, whether the label on the itemis facing up, down, to the side, or at another angle. Based on thespatial coordinate data received from the primary camera 105, theprocessor 141 can determine which of the secondary cameras 110A-J iscapable of capturing a high-quality image of the potential region ofinterest determined by the primary camera 105. The processor 141 canalso determine one or more adjustments to be performed by the one ormore of the secondary cameras 110A-J in order to identify and/or capturean image or video of the potential region of interest, such as, forexample pan, tilt, and/or zoom adjustments. Information regardingadjustments to be performed by one or more of the secondary cameras110A-J and instructions to capture an image of a potential region ofinterest can be transmitted to the one or more of the secondary cameras110A-J.

The central unit 140 can also be configured to receive images capturedby the secondary cameras 110A-J or video streams or feed from thesecondary cameras 110A-J, including live video feeds. The processor 141can be configured to process the images or video to determine if apotential region of interest includes readable information and/or toextract readable information. For example, the processor 141 can beconfigured to decode labels such as barcodes, perform optical characterrecognition, identify images, etc. The readable information extracted bythe processor 141 can be stored in the memory 142 or transmitted to theexternal computer system 150, at which the readable information can bestored, managed, or further processed. The extracted information may beused to allow for further tracking, managing, and processing of an itemhaving the potential region of interest thereon.

In some embodiments, the processor 141 can be configured to determineinstructions for actuation of the one or more indicators 160. Thecentral unit 140 can transmit instructions to the one or more indicators160 to indicate one or more of an item within the defined physical area,the intended location within the defined physical area in which an itemshould be placed, and a resource, such as an employee, vehicle,conveyor, and the like, is assigned to move the item from its currentlocation to the intended location. The intended location can beassociated with the intended destination for the item, as interpreted bythe processor 141 using or from the computer readable code in the regionof interest. In this way, the processor 141 causes the one or moreindicators 160 to actuate, illuminate, display, sound, or otherwiserespond based on the readable information extracted from images or videoof the regions of interest on items. The indicators 160 can include oneor more visible, auditory, and/or haptic indicators. For example, theindicators 160 can include one or more display panels, lights, and/orspeakers. Each indicator 160 can further include processing circuitryfor processing instructions received from the central unit 140 and foractuating an indication based on the instructions received from thecentral unit 140.

In some embodiments, the indicator 160 may be on a mobile computingdevice held, operated, or worn by the resource. For example, a personaldigital assistant, a mobile delivery device, or a smartphone can displaythe intended location in which to place the item, or can emit an audiblesignal, such as speech, indicating the intended location. In someembodiments, the indicator may be part of a wearable computer, such assmart glasses and the like, which can display a heads-up display typemessage, or which can display an augmented reality type indicator of theintended location as the wearer looks around the defined physical area115. For example, if the resource looks at the intended location, thelocation can be highlighted by a lighted area, a square or circle, orother augmented reality type indicator visible through the lens of awearable computing device. Each indicator 160 can include acommunication module for transmitting data to and/or receiving data fromthe central unit.

The secondary camera 110A includes one or more image sensors 111, aprocessor 112, a communication module 113, one or more motors 114, and amemory 116. The image sensors 111 may be charge-coupled device (CCD)pixel sensors, complementary metal-oxide-semiconductor (CMOS) pixelsensors, hybrid CCD/CMOS image sensors or N-typemetal-oxide-semiconductor (NMOS) image sensors. The processor 112controls operations of the secondary camera 110A. The processor 112performs logical and arithmetic operations based on program instructionsstored within the memory 116. The memory 116, which may include bothread-only memory (ROM and random-access memory (RAM), providesinstructions and data to the processor 112. A portion of the memory 116may also include non-volatile random-access memory (NVRAM). Theinstructions in the memory 116 may be executable to implement themethods described herein.

The communication module 113 may include communication circuitry toallow for the transmission and/or reception of data between thesecondary camera 110A and the central unit 140. For example, dataproviding instructions to capture an image of a potential region ofinterest at a particular set of spatial coordinates may be received atthe communication module 113 from the central unit 140. Data providinginstructions to adjust the configuration of the secondary camera 110Acan also be received by the communication module 113. The communicationmodule 113 may be configured to communicate via any wired or wirelesscommunication technologies, such as, for example, Bluetooth, WIFI, orother means.

The one or more motors 114 can include one or more motors configured tocause rotational movement of the secondary camera 110A in horizontaland/or vertical planes in order to perform pan and/or tilt functions.The one or more motors 114 can further include one or more motorsconfigured to adjust a lens assembly (not shown) of the secondary camera110A in order to adjust the focal length of the lens assembly forperformance of zoom functions.

The processor 112 is configured to receive and process data from thecentral unit 140 in order to determine a set of spatial coordinates atwhich to capture an image and to determine adjustments to theconfiguration of the camera 110A, such as pan, tilt, and/or zoomadjustments, required to capture an image at the aforementioned spatialcoordinates. The processor 12 is further configured to determineadjustments to the configuration of the camera 110A, such as pan, tilt,and/or zoom adjustments, required to follow an item and a region ofinterest as they move through the room 101. The processor 111 is furtherconfigured to actuate the one or more motors 114 to adjust the secondarycamera 110A, for example, to a configuration for capturing an image atthe desired spatial coordinates. The processor 111 can also actuate theimage sensors 111 to capture an image, for example, at the desiredspatial coordinates. The processor 111 can further be configured toprocess data from the image sensors 106 and to transmit image data, suchas for example, a captured image, to the central unit 140.

The memory 116 can be used to store instructions for processing datausing the processor 111. Information determined by the processor 111 canbe stored in the memory 116 and/or transmitted to the central unit 140using the communication module 113.

In some embodiments the camera system 100 can be configured to monitoror follow movement of an item having a potential region of interestthereon within the defined physical area 115. For example, if theprocessor 141 determines that an item includes a region of interesthaving readable information, the processor can provide instructions toone or more of the primary camera 105 and secondary cameras 110A tomonitor movement of the item, for example, by receiving image datarelated to the location of the item within the defined physical area andprocessing the received image data to determine the location of the itemwithin the defined physical area.

In some embodiments, an item having a potential region of interest is anitem for delivery. In such embodiments, the primary camera 105 and/orsecondary cameras 110A-J can be configured to determine if the item isdeposited in a storage or transport container. One of processor 107,processor 141, and processor 112 may perform logical operations todifferentiate between the item and the container or transport vehiclebased on size, shape, or any other detectable characteristic. One of theprocessor 107, the processor 141, and the processor 112 may determinethat an item is deposited within a container or transport vehicle basedon receipt of image data through one or more of the primary camera 105and the secondary cameras 110A-J showing the item within or partiallywithin the container or transport vehicle.

In some embodiments, both an item and a container or transport vehiclecan include potential regions of interest. The storage unit or transportvehicle may include encoded information in its region of interestidentifying the storage unit or transport vehicle as a container ortransport vehicle. The item may have encoded information in its regionof interest identifying the item as a parcel or mail piece. In someembodiments, the camera system can determine that the item has beendeposited within the container, within a staging area, a portion of aloading dock, or a transport vehicle by determining that the item ispositioned at a set of spatial coordinates within a set of spatialcoordinates occupied by the container, staging area, loading dockportion, or transport vehicle.

In some embodiments, the storage or transport container may furtherinclude readable information such as a barcode or QR code that can becaptured by the primary camera 105 and/or secondary cameras 110A-J inorder to identify the storage or transport containers. The primarycamera 105 and/or secondary cameras 110A-J can transmit data related toa storage or transport container in which the item is deposited to thecentral unit 140. The processor 141 can process storage or transportcontainer data to associate a particular storage or transport containerwith the item. The item and container association information can bestored in the memory 142 or transmitted to the external computer system150 for further tracking, managing, and processing. The item andcontainer association information may be used to allow for furthertracking, managing, and processing of an item.

In some embodiments, the defined physical area 115 can have certainspatial coordinates mapped to specific intended locations. For example,a portion of the floor of a loading dock can be mapped to a first sortarea, a second portion can be mapped to a second sort area, and so onfor as many sort areas as are needed. The sort areas can comprisepallets or other similar devices. These sort areas may not have acomputer readable code or region of interest associated with them, andthey are identified based on their spatial coordinates. and the like, aswill be described elsewhere herein.

FIGS. 3A-C depict an example of camera system in various stages ofmonitoring an item 120. FIG. 3A depicts the camera system 100, the item120, and a plurality of containers 135A-D positioned within the definedphysical area 115. The area around each container 135A-D is marked withhigh contrast tape 137. The containers 135A-D can comprise a hamper, abin, a pallet, a box, or other similar device. In some embodiments, thecontainers 135A-D can be locations of the floor of the room 101 whosespatial coordinates have been associated with a sort area, or which area virtual container. An item placed within the spatial coordinatescorresponding to a container 135A-D which lacks a physical container canbe determined to be within the virtual container.

The item 120 can be a package, parcel, envelope, mailpiece or otherdelivery object of any shape and size. The item 120 includes a region ofinterest 125 thereon having machine readable data 130. The region ofinterest 125 can include any segment of the item 120 having readabledata that may be detected, captured, and/or processed by the camerasystem 100. The readable data 130 can include any written, printed, orencoded information that can be detected by and captured by a camerasystem. For example, the readable data 130 can include, but is notlimited to, a barcode, a four-state barcode, such as an IntelligentMail® barcode, a data matrix barcode, a modulated bar code, a two-statebar code, a Quick Response (QR) code, a destination address, a returnaddress, and/or a source or sender of the item 120. In some embodiments,the readable data 130 can be a handwritten or printed address, deliverypoint, ZIP code, and the like which can be detected and OCR'd toidentify a destination. In some embodiments, readable data 130 caninclude a barcode or image on a stamp. Readable data 130 may be affixedto, printed on, or written on the item 120. Information that can beextracted from the readable data 130 can include a variety of differenttypes of information associated with the item 120, such as for example,information associated with identifying the item 120, tracking the item120, a destination of the item 120, a source or sender of the item 120,sorting data, routing information regarding the item 120, or any otheritem related data.

The readable data 130 can encode an intended delivery destination of theitem. After the readable data 130 has been captured by the camerasystem, the central unit 140 can extract the intended deliverydestination from the readable data 130, and compare the intendeddelivery destination of the item with a sort plan, a facility plan, orother sorting scheme stored in the database 150.

The containers 135A-D can be configured to receive a plurality of items,such as item 120, for storage and/or transport to another location. Thecontainers 135A-D can be physical containers, such as a bin, pallet, andthe like, and can also be a defined area, such as a staging area, or apredefined portion of a loading dock, or other part of the room 101. Thecontainers 135A-D can also be any container, area, and the like, desiredor useful for segregation or sortation of items according to thereadable data 130

As described above, the primary camera 105 can detect the presence ofthe item 120, as well as the spatial coordinates thereof, as describedherein. The primary camera attempts to identify the region of interest125 of the item 120 as well as the spatial coordinates thereof. If theprimary camera 105 can identify the item 120 but cannot identify theregion of interest 125, the central unit 140 can instruct one or more ofthe secondary cameras 110A-J, to pan, tilt, zoom, and/or focus toidentify the region of interest 125 on the item 120 and the spatialcoordinates thereof. The central unit 140 may instruct one or more ofthe secondary cameras 110A-J having a field of view of the item 120 toidentify the region of interest 125, or may instruct one or more of thesecondary cameras 110A-J, such as those closest to the spatialcoordinates of the item 120, to identify the region of interest 125 onthe item, or to capture an image and send the image to the central unit140 for processing and decoding.

The spatial coordinates of the region of interest 125 can be transmittedto the central unit 140 for further processing. As described above, thecentral unit 140 can determine one or more of the secondary cameras110A-J to capture an image of the region of interest 125. The centralunit 140 can also determine one or more adjustments to be performed bythe one or more of the secondary cameras 110A-J in order to capture animage of the region of interest, such as pan, tilt, and/or zoomadjustments. In some embodiments, the cameras can detect the spatialcoordinates of the item 120 and the region of interest 125. In someembodiments, the central unit 140 can determine the spatial coordinatesof the item 120 and the region of interest 125.

As depicted in FIG. 3A, the secondary camera 110H is positioned closestto the item 120 and has the best field of view, depth of field, angle,and the like to capture a high quality image, including a still image orvideo. In the example depicted in FIG. 3A, the secondary camera 110H isdetermined by the central unit 140 as the one of the secondary cameras110A-J to capture an image of the region of interest 125. The centralunit 140 can transmit instructions to the secondary camera 110H toperform adjustments in order to capture an image of the region ofinterest 125 and to capture an image of the region of interest 125.

FIG. 3B depicts an example of the camera system 100 and item 120following adjustment of the camera 110H. As shown in FIG. 3B the camera110H has panned in a direction towards the region of interest 125 fromthe position of the camera 110H shown in FIG. 3A. After adjustment, thecamera 110H captures an image of the region of interest 125. The imageis transmitted to the central unit 140 for processing. The central unit140 extracts information from the data 130 of the region of interest125. As described above, the data 130 can include a variety of differenttypes of information associated with the item 120, such as for example,information associated with identifying the item 120, tracking the item120, a destination of the item 120, a source or sender of the item 120,sorting data, routing information regarding the item 120, or any otheritem related data.

In some embodiments, the central unit 140 can receive a feed of images,or a video feed, and determine a spatial coordinate of the region ofinterest for each image. The change in the spatial coordinates can beextrapolated to determine a likely path the item 120 will travel. Thecentral unit 140 can use the predicted path of travel for the item 120to instruct other of the secondary cameras 110A-J to move and prepare totake an image or track the item 120 as it moves closer to them or withintheir fields of view. The actual path of the item 120 through thedefined physical area 115 can be stored.

As described above, the readable data 130 can encode an intendeddelivery destination of the item. After the readable data 130 has beencaptured by the camera system, the central unit 140 can extract theintended delivery destination from the readable data 130, and comparethe intended delivery destination of the item with a sort plan, afacility plan, or other sorting scheme stored in the database 150. Thecentral unit can further determine an intended location, such ascontainers 135A-D, within the defined physical area 115 into which theitem 120 should be placed or deposited based on the intended deliverydestination. In some embodiments, the central unit can further determineor assign an employee to transport the item 120 from its location to theintended location for placement of the time 120.

FIG. 3C shows the item 120 paced within container 135A, and imaging andtracking being done by secondary camera 110B, as secondary camera 110Bis the closest to the location of the item 120. As the item 120 isplaced in the container 135B, the central unit 140 can update theposition of the item 120 in the database 150, such as associating thecontainer 135A, including the spatial coordinates of the container 135A,with the item record for the item 120 in the database 150.

FIGS. 3A-C further show the one or more indicators 160. The indicators160 can be configured to indicate one or more of an item within thedefined physical area, such as item 120, the intended location withinthe defined physical area 115 in which the item should be placed, and anemployee assigned to move the item from its location to the intendedlocation. The indicators 160 may include one or more visible, auditory,and/or haptic indicators. In some embodiments, the indicators 160generate an audio signal to direct placement of the item 120 to theintended location within the defined physical area 115. For example, theindicators 160 may include one or more speakers. In some embodiments,the primary camera 105 and/or one or more of the cameras 110A-J mayinclude a speaker for providing an audio signal to direct placement ofthe item 120. The audio signal may include a voice recording stating oneor more of a name of an employee, an identifier for the item 120, and anassigned name or coordinates of the intended location, such as anidentifier for the container 135A-D into which the item 120 should beplaced.

In some embodiments, the indicators 160 may provide a visible indicationof the intended location in which the item 120 should be placed. In someembodiments, the indicators 160 can include a display screen. Thedisplay screen can display one or more of a name of an employee, anidentifier for the item 120, and an assigned name or coordinates of theintended location. In some embodiments, the display screen can display amap of the defined physical area 115. The map can indicate the intendedlocation, for example, by a symbol or marker such as a dot. In someembodiments, the map can further show the current location of the item120, for example, by a symbol or marker such as a dot. In someembodiments, the map can indicate a path from the location of the item120 to the intended location. In some embodiments, the display screencan display a video providing visual and/or audible indication of theintended location.

In some embodiments, the indicators 160 can include one or more lightsources. The one or more light sources can be configured to emit lighton one or more of the item 120 and the intended location for placementof the item 120. In some embodiments, the primary camera and/or one ormore of the secondary cameras 110A-J can include a light sourceconfigured to emit light on one or more of the item 120 and the intendedlocation. In some embodiments, a light source may include one or moremotors allowing the light source to pan or tilt within the definedphysical area 115. In some embodiments, one or more light sources mayilluminate a trail or route within the defined physical area 115 fromthe location of the item 120 to the intended location. In someembodiments, a light source may be positioned above or directed at eachof containers 135A-D. These light sources may be fixed in position, andcan be in communication with the central unit 140. When the identifieron the item 120 is read, and when the destination is identified in thecentral unit 140, the central unit 140 instructs the light source aboveor directed at the container 135A-D corresponding to the identifieddestination for the item 120.

The central unit 140 can be configured to communicate with the one ormore indicators 160 via the communication module 143. The central unitcan transmit instructions to the one or more indicators instructing theindicators to indicate one or more of a name or other identifier of anemployee, an identifier for the item 120, and an assigned name orcoordinates of the intended location. In some embodiments, communicationmodule 143 can transmit a signal indicating the intended location to amobile device, such as a mobile phone, in possession of an employeehandling the item 120 indicating the intended location of the item 120within the defined physical area 115. This will identify to theresource, such as a carrier, user, employee, etc., into which container135A-D the item 120 should be placed.

In the example shown in FIGS. 3A-C, central unit 140 determines that theintended location for placement of the item 120 within the definedphysical area 115 is the container 135A. The central unit 140 furtherinstructs the one or more indicators 160 to indicate that the intendedlocation within the defined physical area 115 for placement of the item120 is the container 135A.

The central unit 140 can also be configured to instruct one or more ofthe primary camera 105 and the secondary cameras 110A-J to monitor thelocation of the item 120 within the defined physical area 115, forexample, by receiving image data related to the location of the item 120within the defined physical area 115 and processing the received imagedata to determine the location of the item 120 within the definedphysical area 115. In some embodiments, the one or more indicators 160can provide an indication of the current location of the item 120 as itis moved within the defined physical area 115 to the intended location.For example, a display screen may show a marker representing theposition of the item 120 moving across a map representing the definedphysical area 115.

In the example shown in FIGS. 3A-C, the item 120 is moved from thelocation shown in FIG. 3B and deposited within the container 135A asshown in FIG. 3C. As described above, one or more of the primary camera105 and secondary cameras 110A-J monitor the movement of the item 120 asit is moved between the location shown in FIG. 3B and the container135A. Data related to the location of the item 120 can be transmittedfrom the primary camera 105 and/or secondary cameras 110A-J to thecentral unit 140 for processing. The processor 141 may determine thatthe item 120 is deposited within the container based on receipt of imagedata through one or more of the primary camera 105 and the secondarycameras 110A-J showing the item within or partially within the container135A. In some embodiments, the processor 141 may determine that the item120 is deposited within the container based on a determination that theitem 120 has passed over the high contrast tape 137. In someembodiments, one of processor 107, processor 141, and processor 112 mayperform logical operations to differentiate between the item 120 and thecontainer 135A based on size, shape, or any other detectablecharacteristic. In some embodiments, the one or more indicators 160 mayprovide an indication that the item 120 is positioned within thecontainer 135A.

In some embodiments, the container 135A corresponds to a set of spatialcoordinates within the defined physical area. For example, the container135A can be a section of a staging area or a loading dock where itemsintended for delivery at a common destination or within a commongeographical region are staged for delivery. When the item 120 is placedwithin the spatial coordinates of the container 135A, the central unit140 records the location of the item 120 within the container andupdates the database 150 with the location of the item 120.

While high contrast tape 137 is shown in FIGS. 3A-C, any visible markerdesignating a particular area of the defined physical area 115 can berecognized by the camera system 100. For example, areas aroundcontainers 135A can be designated with paint. In some embodiments, thecontainers 135A-D may be constructed out of or painted with a highcontrast attribute or pattern.

Container 135A also contains a region of interest (not shown) havingreadable data. The camera system 100 may be configured to detect theregion of interest on the container 135A and extract the readable datain the same manner as described above with respect to the region ofinterest 125 of the item 120. FIG. 3C shows that secondary camera 110Bhas been adjusted to capture an image of the region of interest of thecontainer 135A. The captured image can be transmitted to the centralunit 140 for processing.

The readable data on container 135A can include a variety of differenttypes of information associated with the container 135A, such as forexample, information associated with identifying the container 135A,tracking the container 135A, a destination of the container 135A,sorting data, routing information regarding the container 135A,information associated with the items within the container 135A, or anyother container related data.

In some embodiments, the camera system can be configured todifferentiate between the item 120 and the container 135A based oninformation encoded in the respective regions of interest of each. Thecontainer 135A may include encoded information in its region of interestidentifying the container 135A as a container. The item 120 may haveencoded information in the data 130 identifying the item 120 as an item.In some embodiments, the camera system 100 can determine that the item120 has been deposited within the container 135A by determining that theitem 120 is positioned at a set of spatial coordinates within a set ofspatial coordinates occupied by the container 135A.

After determining that the item 120 has been deposited within container135A, the processor 141 of the central unit can be configured to processitem 120 data and container 135A data to create a record of associationbetween the item 120 and the container 135A. The record of associationbetween the item 120 and the container 135A can be sent to a computingsystem or database such as computing system 150 for storage, management,or further processing. The record of association between the item 120and the container 135A can allow for the item 120 and other items withinthe container 135A to be tracked along with the container 135A if thecontainer 135A is transported to a different location.

FIG. 4 depicts a flowchart of an exemplary process 400 for determiningitem data. The process begins at step 410, wherein a potential region ofinterest 125 on the item 120 is detected using the primary camera 105.The primary camera 105 detects the potential region of interest usingone or more image sensors 106.

After the potential region of interest is detected, the process 400moves to a step 420, wherein spatial coordinates for the potentialregion of interest are determined. The spatial coordinates can bedetermined by the processor 107 processing data received from the imagesensors 106. The spatial coordinates can include x, y, and zcoordinates. In some embodiments, spatial coordinates are determinedbased on distances from the primary camera 105, the angle, depth offield, focus level, of the primary camera 105 when the image is taken.In some embodiments, spatial coordinates may be determined based on aprogrammed reference map having coordinate data for the primary camera105 and secondary cameras 110A-J.

After the spatial coordinates of the item 120 are determined, theprocess 400 moves to a step 430, wherein one or more of the secondarycameras 110A-J is instructed by the central unit 140 or the primarycamera 105 to capture an image of the potential region of interest 125.The secondary camera 110 can be determined by the central unit 140 basedon spatial coordinate information received from the primary camera 105.The spatial coordinate information can be transmitted from the primarycamera 105 using the communication module 108 and received at thecentral unit 140 using the communication module 143.

After the secondary camera 110 is determined, the process 400 moves to adecision state 440, wherein a decision is made whether the configurationof the secondary camera needs to be adjusted in order to capture animage of the potential region of interest. The processor 141 of thecentral unit 140 can determine, based on the orientation of thesecondary camera and the spatial coordinates of the potential region ofinterest, whether the secondary camera should undergo a pan, tilt,and/or zoom function in order to be in an appropriate configuration tocapture an image of the potential region of interest.

If it is determined in state 440 that the configuration of the secondarycamera 110 needs to be adjusted, the process 400 moves to a step 450,wherein the secondary camera 110 is adjusted to an appropriateconfiguration for capturing an image of the potential region of interest125. The central unit 140 can transmit instructions for one or moreadjustments to the secondary camera 110 via the communication module143. The instructions can be received at the communication module 113 ofthe secondary camera 110. The processor 112 of the secondary camera 110can process the instructions, and in response, actuate one or more ofthe motors 114 to perform a pan, tilt, and/or zoom function.

After the secondary camera 100 is adjusted to the appropriateconfiguration, or if a determination is made in state 440 that thesecondary camera 110 does not need to be adjusted, the process 400 movesto a step 460 where an image is captured of the region of interest usingthe secondary camera 110. Instructions to capture the image may betransmitted from the central unit 140 to the secondary camera. Theprocessor 113 of the secondary camera may process the instructions, andin response, actuate the image sensors 111 to capture the image. In someembodiments, the image of a region of interest may be captured, butinformation from the region of interest, or from the label, is notreadable. In this case, an alarm can sound, an error message can begenerated, or any other desired response indicating an error or problem.In some embodiments, the cameras may identify an item, but cannotidentify a region of interest. This scenario can also result ingenerating an error message, alarm, and the like. the error scenariosmay also result in the processor providing further instructions, such asrepositioning the item, stopping movement of the item to allow forcapturing an image while stationary in an attempt to improve imagequality, taking item to a predetermined location in the facility,scanning the item with a scanner, and the like.

After the image is captured, the process 400 moves to a step 470,wherein data is extracted from the image. The captured image can betransmitted from the secondary camera to the central unit 140. Theprocessor 141 of the central unit 140 can process the capture imaged toextract readable data. The readable data can include any written,printed, or encoded information that can be detected by and captured bythe camera system 100, such as, for example, a barcode, a four-statebarcode, such as an Intelligent Mail® barcode, a data matrix barcode, amodulated bar code, a two-state bar code, a QR code, a destinationaddress, a return address, and/or a source or sender of the item.Information that can be extracted from the readable data can include avariety of different types of information associated with the item, suchas for example, information associated with identifying the item,tracking the item, a destination of the item, a source or sender of theitem 120, sorting data, routing information regarding the item, or anyother item related data. Extracted data can be stored in the memory 142or transmitted to external computer system 150 for further managingtracking, and processing.

FIG. 5 depicts a flowchart of an exemplary process 500 for associatingan item with a container within a defined physical area, such as one ofthe containers 135A. The process 500 begins at a point after process 400has been performed, and item data is determined for an item, such asitem 120, as depicted in FIG. 4.

After item data is determined as described in process 400, the process500 moves to a step 510 wherein an intended container for placement ofthe item 120 within the defined physical area 115, such as one of thecontainers 135A-D, is determined. The intended container can bedetermined based on a comparison of the determined item data with a sortplan, a facility plan, or other sorting scheme for the defined physicalarea. For example, in some embodiments, an intended container forplacement of the item may be determined based on the intended deliveryaddress of the item. Items 120 that are intended for delivery from aparticular facility or to a defined geographic area may be grouped orstaged together for transport to another facility, or for delivery fromthe facility. The processes and system described here can be employed atany level of a distribution network including regional processingfacilities, intake facilities, or individual delivery units, such as alocal post office.

After the intended container for placement of the item is determined,the process 500 moves to a step 520, wherein the intended container isindicated. The intended location may be indicated by one or moreindicators, such as indicators 160 described above. The one or moreindicators can provide one or more of a visible, audible, or hapticindication of the intended location. The indicators may further provideinstructions for moving the item from a current location to the intendedcontainer. The indicators may include one or more lights, displayscreens, a lighted pathway, speakers, or the like.

After the intended container is indicated, the process moves to a step530, wherein movement of the item is monitored. The movement of the itemcan be tracked by one or more of the primary camera 105 and thesecondary cameras 110A-J, for example, by receiving image data relatedto the location of the item within the defined physical area andprocessing the received image data to determine the location of the itemwithin the defined physical area. In some embodiments, the one or moreindicators can provide an indication of the location of the item whileit is moved throughout the defined physical area.

After the movement of the item 120 is monitored, the process 500 movesto a step 540, wherein a determination is made whether the item has beendeposited in a container, such as one of containers 135A-D. The primarycamera 105, secondary cameras 110A-J, or central unit 105, may beconfigured to process data received from image sensors 106 and/or theimage sensors of the secondary cameras to determine that the item wasdeposited in a container. For example, the processor 141 may determinethat the item is deposited within the container based on receipt ofimage data through one or more of the primary camera 105 and thesecondary cameras 110A-J showing the item within or partially within thecontainer. In some embodiments, the processor 141 may determine that theitem is deposited within a container based on a determination that theitem has moved across high contrast tape defining the periphery of acontainer, or that the item has been placed at a set of coordinatescorresponding to a container. In some embodiments, one of processor 107,processor 141, and processor 112 may perform logical operations todifferentiate between the item and the container based on size, shape,or any other detectable characteristic.

If a determination is made that the item has not been deposited within acontainer, the process returns to step 530, wherein item movementcontinues to be monitored. If a determination is made that the item hasbeen deposited within a container, the process 500 moves to a step 550,wherein container data is determined. Container data can be determinedby the camera system 100 in a similar manner as described for item datain process 400 depicted in FIG. 4. For example, the primary camera 105can detect a region of interest on the container, as well as the spatialcoordinates of the region of interest. The primary camera 105 cantransmit data related to the spatial coordinates of the region ofinterest to the central unit 140. The central unit 140 can process thespatial coordinate data to determine one of the secondary cameras 110A-Jthat is appropriate to capture an image of the region of interest. Thecentral unit 140 can transmit instructions to the one of the secondarycameras 110A-J to capture an image of the region of interest. The one ofthe secondary cameras 110A-J can capture an image of the region ofinterest. The one of the secondary cameras 110A-J can transmit thecaptured image to the central unit 140. The central unit 140 can processthe image to extract readable data. The readable data can include anywritten, printed, or encoded information that can be detected by andcaptured by the camera system 100, such as, for example, a barcode, afour-state barcode, such as an Intelligent Mail® barcode, a data matrixbarcode, a modulated bar code, a two-state bar code, a QR code, adestination address, a return address, and/or a source or sender of theitem. Information that can be extracted from the readable data caninclude a variety of different types of information associated with thecontainer, such as for example, information associated with identifyingthe container, tracking the container, a destination of the container,sorting data, routing information regarding the container, informationassociated with the items within the container, or any other containerrelated data. Extracted data can be stored in the memory 142 ortransmitted to external computer system 150 for further managingtracking, and processing.

In some embodiments, the extracted data can be compared to the intendedcontainer determination. If a determination is made that the item hasbeen deposited in a container other than the intended container, the oneor more indicators may provide an indication of incorrect placement ofthe item. In some embodiments, the one or more indicators may provideinstructions for moving the item from an incorrect container to theintended container.

In some embodiments, a container corresponds to a set of spatialcoordinates within the defined physical area. For example, a containercan be a section of a staging area or a loading dock where itemsintended for delivery at a common destination or within a commongeographical region are staged for delivery. In some embodiments, acontainer does not include a region of interest. In some embodimentscontainer data may be determined based on a sort plan, a facility plan,or other sorting scheme for the defined physical area.

After container data is determined, the process 500 can move to a step560, wherein a record is created associating the item 120 with thecontainer 135 in which the item 120 is deposited. The record ofassociation between the item 120 and the container 135 in which the item120 is deposited can allow for the item 120 to be tracked along with thecontainer 135, such as via a nesting association, if the container 135is transported to a different location.

In an alternative embodiment, container data is determined prior todetermining whether the item is deposited within the container. In suchan embodiment, the container may include encoded information in itsregion of interest identifying the container as a container. The itemmay include encoded information in its region of interest identifyingthe item as an item. The camera system 100 can determine that the itemhas been deposited within the container by determining that the item ispositioned at a set of spatial coordinates within a set of spatialcoordinates occupied by the container.

In some embodiments, the location of the item 120 within thepredetermined area 115 can be identified using a computing device, suchas a mobile delivery device, a smartphone, or a wearable computer. Forexample, a delivery resource, such as an employee, may wish to find aparticular item. The delivery resource can input a unique identifier forthe item, such as the identifier encoded within the computer readablecode, into the computing device. The computing device can communicatewith the database 150 and/or the central unit 140 to retrieve the itemlocation. The central unit 140 can, in response to the query from thecomputing device, activate the indicator, such as illuminating thecontainer 135 in which the item 120 is located, display the location ona screen, display the location on the computing device, provide anaugmented reality-type display on a wearable computer, and the like, toalert the delivery resource to the location of the item 120.

It should be appreciated that while the camera system is describedherein with respect to mail distribution, the systems and methodsdescribed herein may be applicable to any item that may include machinereadable information affixed to and/or printed thereon. In addition, thesystems and methods described herein may be used in conjunction with anyobject that may be imaged and processed to extract information regardingthe item.

Implementations disclosed herein provide systems, methods, and apparatusfor monitoring a defined physical area. One skilled in the art willrecognize that these embodiments may be implements in hardware,software, firmware, or any combination thereof.

The functions described herein may be stored as one or more instructionson a processor-readable or computer-readable medium. The term“computer-readable medium” refers to any available medium that can beaccessed by a computer or processor. By way of example, and notlimitation, such a medium may comprise RAM, ROM, EEPROM, flash memory,CD-ROM or other optical disk storage, magnetic disk storage or othermagnetic storage devices, or any other medium that can be used to storedesired program code in the form of instructions or data structures andthat can be accessed by a computer. Disk and disc, as used herein,includes compact disc (CD), laser disc, optical disc, digital versatiledisc (DVD), floppy disk and Blu-ray® disc where disks usually reproducedata magnetically, while discs reproduce data optically with lasers. Itshould be noted that a computer-readable medium may be tangible andnon-transitory. The term “computer-program product” refers to acomputing device or processor in combination with code or instructions(e.g., a “program”) that may be executed, processed or computed by thecomputing device or processor. As used herein, the term “code” may referto software, instructions, code or data that is/are executable by acomputing device or processor.

Software or instructions may also be transmitted over a transmissionmedium. For example, if the software is transmitted from a website,server, or other remote source using a coaxial cable, fiber optic cable,twisted pair, digital subscriber line (DSL), or wireless technologiessuch as infrared, radio, and microwave, then the coaxial cable, fiberoptic cable, twisted pair, DSL, or wireless technologies such asinfrared, radio, and microwave are included in the definition oftransmission medium.

The methods disclosed herein comprise one or more steps or actions forachieving the described method. The method steps and/or actions may beinterchanged with one another without departing from the scope of theclaims. In other words, unless a specific order of steps or actions isrequired for proper operation of the method that is being described, theorder and/or use of specific steps and/or actions may be modifiedwithout departing from the scope of the claims.

It should be noted that the terms “couple,” “coupling,” “coupled” orother variations of the word couple as used herein may indicate eitheran indirect connection or a direct connection. For example, if a firstcomponent is “coupled” to a second component, the first component may beeither indirectly connected to the second component or directlyconnected to the second component. As used herein, the term “plurality”denotes two or more. For example, a plurality of components indicatestwo or more components.

The term “determining” encompasses a wide variety of actions and,therefore, “determining” can include calculating, computing, processing,deriving, investigating, looking up (e.g., looking up in a table, adatabase or another data structure), ascertaining and the like. Also,“determining” can include receiving (e.g., receiving information),accessing (e.g., accessing data in a memory) and the like. Also,“determining” can include resolving, selecting, choosing, establishingand the like.

The phrase “based on” does not mean “based only on,” unless expresslyspecified otherwise. In other words, the phrase “based on” describesboth “based only on” and “based at least on.”

In the foregoing description, specific details are given to provide athorough understanding of the examples. However, it will be understoodby one of ordinary skill in the art that the examples may be practicedwithout these specific details. For example, electricalcomponents/devices may be shown in block diagrams in order not toobscure the examples in unnecessary detail. In other instances, suchcomponents, other structures and techniques may be shown in detail tofurther explain the examples.

Headings are included herein for reference and to aid in locatingvarious sections. These headings are not intended to limit the scope ofthe concepts described with respect thereto. Such concepts may haveapplicability throughout the entire specification.

It is also noted that the examples may be described as a process, whichis depicted as a flowchart, a flow diagram, a finite state diagram, astructure diagram, or a block diagram. Although a flowchart may describethe operations as a sequential process, many of the operations can beperformed in parallel, or concurrently, and the process can be repeated.In addition, the order of the operations may be re-arranged. A processis terminated when its operations are completed. A process maycorrespond to a method, a function, a procedure, a subroutine, asubprogram, etc. When a process corresponds to a software function, itstermination corresponds to a return of the function to the callingfunction or the main function.

The previous description of the disclosed implementations is provided toenable any person skilled in the art to make or use the presentinvention. Various modifications to these implementations will bereadily apparent to those skilled in the art, and the generic principlesdefined herein may be applied to other implementations without departingfrom the spirit or scope of the invention. Thus, the present inventionis not intended to be limited to the implementations shown herein but isto be accorded the widest scope consistent with the principles and novelfeatures disclosed herein.

What is claimed is:
 1. A system for sorting an item comprising: aprimary camera having a field of view comprising a portion of a definedphysical area, the primary camera in communication with a central unit,and where the primary camera is configured to identify an item withinthe defined physical area; a plurality of secondary cameras incommunication with the central unit, each of the plurality of secondarycameras having a field of view comprising a section of the definedphysical area; and wherein the central unit comprises one or moreprocessors configured to: determine spatial coordinates of a region ofinterest located on the item within a defined physical area, based onimage data received by the primary camera; identify one or more of theplurality of secondary cameras having a field of view including thedetermined spatial coordinates; and cause the identified one or more ofthe plurality of secondary cameras to capture an image of the region ofinterest.
 2. The system of claim 1, wherein the one or more processorsare further configured to process an image of the region of interest toextract machine readable information located within the region ofinterest.
 3. The system of claim 2, wherein the information comprises anintended delivery destination for the item.
 4. The system of claim 3,the one or more processors are further configured to identify a locationwithin the defined physical area for placement of the item based on theintended delivery destination for the item.
 5. The system of claim 4,further comprising one or more indicators configured to provide anindication of the determined location within the defined physical areafor placement of the item.
 6. The system of claim 2, wherein the regionof interest comprises a segment of an item, wherein the machine-readableinformation comprises one or more of information associated withidentifying the item, tracking the item, a destination of the item, asource or sender of the item, sorting data, and routing informationregarding the item.
 7. The system of claim 1, wherein the potentialregion of interest comprises a segment of an item, wherein the one ormore processors are configured to: provide instructions to one or moreof the primary camera and the plurality of secondary cameras to captureimage data related to the movement of the item having the potentialregion of interest; and determine if the item having the potentialregion of interest is deposited in a container.
 8. The system of claim7, wherein the processor is further configured to store data associatingan item with a container in which the item is deposited.
 9. A method fortracking items comprising: detecting, via a primary camera, a potentialregion of interest located on an item within a defined physical area;determining spatial coordinates within the defined physical area of thepotential region of interest; determining a secondary camera of aplurality of secondary cameras to capture an image of the potentialregion of interest based at least in part on the determined spatialcoordinates; and capturing an image of the potential region of interestby the determined secondary camera.
 10. The method of claim 9, furthercomprising extracting machine-readable information from in the region ofinterest.
 11. The method of claim 10, further comprising: determining alocation within the defined physical area for placement of the itembased on the information extracted from the region of interest; andindicating the determined location within the defined physical area forplacement of the item.
 12. The method of claim 9, further comprisingcapturing image data related to the movement of the potential region ofinterest; and processing the captured image data related to the movementof the potential region of interest to determine information regardingthe location of the potential region of interest.
 13. The method ofclaim 12, wherein processing the captured image data related to themovement of potential region of interest comprises determining that theitem was deposited in a container located within the defined physicalarea.
 14. A system for capturing images in a defined physical area, thesystem comprising: means for detecting a potential region of interestlocated on an item within a defined physical area; means for determiningspatial coordinates within the defined physical area of the potentialregion of interest; means for determining a secondary camera of aplurality of secondary cameras to capture an image of the potentialregion of interest based at least in part on the determined spatialcoordinates; and means for capturing an image of the potential region ofinterest by the determined secondary camera.